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This application is submitted in the name of Daniel Watkins, assignor to LSI Logic 
Corporation, a Delaware corporation. 

5 SPECIFICATION 

TTTLE OF THE INVENTION 
PORTABLE DIGITAL RECORDER 

FIELD OF THE INVENTION 
The present invention relates to a portable digital recorder for digital video and/or 
audio input. 

BACKGROUND OF THE INVENTION 
Conference meetings and classroom presentations have sometimes been recorded 
in an audio/visual (AA^) format. In the past, film cameras used photographic film, which 
had to be chemically developed for the images and synchronized with the audio track to 
become available for viewing. Camcorders have been made available more recently; 
these employ magnetic tape to store analog AA^. The recorded events can be played 
back after the tape has been rewound. However, tape editing can be labor-intensive, 
and the tape may not be reviewed until the recording is completed. 

More recently, the introduction of the digital camera has further facilitated 
portability and convenience for AA^ recordings that do not require motion-picture video. 
Consumer demand has reduced the prices for digital cameras. Pre-programming of the 
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recording sequence is available either directly or through website control. The received 
video may be supplied by an inexpensive optical lens and low-pass filter to focus the 
light onto typically one charge-coupled device (CCD) or a prism with three such image 
sensors. Digital cameras typically have sixty -four grey levels or thirty- two levels of red- 
green-blue (RGB) color with 320x240 pixel resolution at about ten frames per second 
digitally transmitted via a serial or parallel port to a computer. Such digital cameras may 
use lossy compression to reduce the memory requirements for storing the images such as 
developed under the Joint Photographers Expert Group (JPEG) standard. 

A digital camera typically includes a liquid crystal diode (LCD) display to view 
the image in real-time (contemporaneous with recording) for monitoring the image 
quality. The LCD display provides visual feedback for focal-stop aperture setting, lens 
focusing, background cropping, etc. Subsequent playback may be provided by 
connecting the digital camera to a television set. Television receivers are generally 
compliant with either the National Television Systems Committee (NTSC) standard in 
North America, or the Phase Altemating Line (PAL) standard. Altematively, the image 
may be played back on a personal computer (PC) through a PC attachment (PC- AT A) 
interface. 

The video information may be represented by pixels having eitiier RGB or YUV 
component values. In the YUV, brightness or luminance is denoted by Y, and 
chromance by U and V, where U may be represented as B - Y (blue minus luminance) 
and V as R - Y (red minus luminance). A video decoder may format video data for 
display under one of a conunonly used set of sampling frequencies, which are described 
as multiples of 3.75 MHz, the lowest common frequency for NTSC and PAL. For 
example, a 4:2:0 system digitizes Y at sampling frequency of 13.5 MHz, while U and V 
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are sampled at 6.75 MHz every other line. A 4:4:4 system samples the luminance and 
color channels all at 13.5 MHz. 

A system block diagram of a commercially available digital camera chip is 
presented in FIG. 1. This example is available from LSI Logic Corporation of Milpitas, 
5 California. The digital camera (dcam) device 10 of the depicted example is designed to 
receive an image 12. The camera lens 14 focuses the image 12 for the photons to be 
counted in the CCD 16. The image is digitally converted by the analog- to-digital 
converter (ADC) 18. The ADC 18 produces an input signal 20 to the CCD pre- 
processor 22 in the digital camera device 10. 
10 The pre-processor 22 transmits data to several interconnected components 

including a JPEG coder/decoder (codec) 24, a 10-channel direct memory access (DMA) 
^ controller 26, a memory controller 28, a PC-ATA interface 30, general purpose 

input/output (I/O) interface 32, a serial I/O interface 34, and an on-screen display 
controller 36. The display controller 36 controls a LCD video controller 38 and a 
15 NTSC/PAL encoder 40 with a video digital-to-analog converter (DAC) 42. 

The memory controller 28 may retrieve processing instructions stored in dynamic 
random access memory (DRAM) 44 and/or read-only memory (ROM) 46. The PC-ATA 
interface 30 may be associated with flash memory 48 or PC card, in which the received 
image 12 may be stored for subsequent retrieval. The LCD controller may be connected 
20 to the camera's LCD display 50 to provide immediate visual feedback to the digital 

camera operator. As an alternative to the small screen provided by the LCD display 50, 
the serial I/O 34 may be linked to a PC interface 52 attached to a video monitor. The 
video DAC 42 may be connected to a television set 54 or other monitor as an alternative 
A/V display device. 
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The introduction of the reduced instruction set computer (RISC) has facilitated 
processing for some appHcations. The dcam device 10 may be controlled by a central 
mini-RISC microprocessor 56. Image rendering may be performed by a pixel co- 
processor 58. A single-cycle multiplier/accumulator 60 may support auxiliary image 
5 processing. Real-time operating systems for AA^ embedded application processing in 
RISC chips include Nucleus, pSOS and VxWorks. Nucleus is available from Accelerated 
Technology Inc. of Mobile, Alabama; pSOS is available from Gespas, Inc. of Mesa, 
Arizona; VxWorks is available from Wind River Systems of Alameda, California. 
Current digital cameras have a number of drawbacks, however. Recording 
^ 2 10 parameters such as the image capture interval and pixel resolution must be decided 
];Li ahead of time using pre-programmed instructions, thereby limiting operational flexibiUty. 

i's ^ 

Also, digital cameras do not permit simultaneous playback during the recording process. 

in 

"L; After the AA^ recording has begun, a person arriving late to the presentation cannot 

review the previous exchanges without interrupting the ongoing recording of the 
j^^ 15 current proceedings. 

S' 

1=^ Memory usage in a digital camera is not optimized to maximize a particular 

t ; 

feature, such as record duration. Typically, the user must resolve competing issues 
manually to most efficiently utiUze the available memory. If during a presentation, an 
important image should be recorded, an earUer lower priority image cannot be easily 
20 overwritten. Instead, additional memory must be provided until it is consumed. 

Editing can be performed only after the recording has been completed. In order 
to create multiple versions of the AA^ record to disseminate to separate destinations, 
several copies of the recorded source data are needed, with the attendant costs in 
additional equipment and time devoted to playback and editing. 
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SUMMARY OF THE INVENTION 
A method and apparatus for recording digital video and/or audio signals include 
input audio and video interfaces, a memory, a video frame selector, and output audio and 
5 video interfaces. In an alternate embodiment, the method and apparatus include input 
audio and video interfaces, a first memory, a second memory for playback, and output 
audio and video interfaces. Another embodiment further includes a memory optimizer 
for maximizing a chosen criterion such as audio duration, image capture frequency or 
pixel resolution. 

10 

3 OBJECTS AND ADVANTAGES OF THE INVENTIQN 

I Fi 

i z t 

Q The invention is designed to enable improved capabiUties in a portable digital 

f"'y 

10 recorder for AA^ events at meetings, classrooms or other documented formats. These 

in 

"F features include but are not limited to: 

O 15 (a) control of audio signals and visual imagery for conditional capture based on selected 

f s i 

criteria or with changes in time, 

(b) playback of an AA^ recording v^hile recording proceeds apace, 

(c) audio input from a separate channel connected to a website including insertion of 
markers for extraction of selected recording segments for separate destinations, 

20 (d) automatic optimization of memory as constrained by video resolution targets and 
recording time, 

(e) interactive website control of the recording based on data transmission rate and pixel 
resolution targets, and 

(f) compressing image differences with time for displaying difference in meeting 
25 activities. 
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BRIEF DESCRIPTION OF THE HGURES 

FIG. 1 is a block diagram illustrating a digital camera chip and associated 
hardware in accordance with the prior art. 

FIG. 2 is a block diagram illustrating a digital camera chip and associated 
hardware in accordance with a presently preferred embodiment of the present invention. 

FIG. 3 is a block diagram illustrating a digital camera chip and associated 
hardware in accordance with a presently preferred embodiment of the present invention. 

FIG. 4 is a block diagram illustrating the reverse and review functions in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 5 is a block diagram illustrating the optimization function in accordance with 
a presently preferred embodiment of the present invention. 

FIG. 6 is a block diagram illustrating the reverse and overwrite functions in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 7 is a block diagram illustrating the selection, edit and file record functions in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 8 is a block diagram illustrating the image translation compression in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 9 is a block diagram illustrating the software structure for the digital camera 
chip in accordance with a presently preferred embodiment of the present invention. 

FIG. 10 is a block diagram illustrating the portable AA^ recorder software in 
accordance with a presently preferred embodiment of the present invention. 

FIG. 11 is a diagram of the portable AA^ recorder on a platform stand in 
accordance with a presently preferred embodiment of the present invention. 
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FIG. 12 is a diagram of the portable AA^ recorder on a wristband showing 
connected peripheral output devices in accordance with a presently preferred 
embodiment of the present invention. 

FIG. 13 is a diagram of the portable AA^ recorder on a wristband showing 
5 connected peripheral input devices in accordance with a presently preferred 
embodiment of the present invention. 
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DETAILED DESCRIPnON OF THE PREFERRED EMBODIMENTS 
Those of ordinary skill in the art will realize that the following description of the 
present invention is illustrative only and not in any way limiting. Other embodiments of 
the invention will readily suggest themselves to such skilled persons having the benefit 
of the within disclosure. 

In accordance with a presently preferred embodiment of the present invention, 
the components, process steps, and/or data structures may be implemented using various 
types of operating systems, computing platforms, computer programs, and/or general 
purpose machines. In addition, those of ordinary skill in the art will readily recognize 
that devices of a less general purpose nature, such as hardwired devices, or the like, may 
also be used without departing from the scope and spirit of the inventive concepts 
disclosed herewith. 

The present invention is directed to a portable digital recorder, also known as a 
portable digital terminal or PDT for audio/visual (AA^) recording. The PDT may 
incorporate input interfaces for audio and video signals, a memory for storing the input 
signals, a video frame selector, and output audio and video interfaces. In addition or 
altematively to the video frame selector, the PDT may include an auxiliary memory (e.g., 
a segregated memory location) for playback. The PDT may further include a memory 
optimizer for maximizing a chosen criterion such as audio duration, image capture 
frequency or pixel resolution. 



Image Selection 

The PDT may receive an image to be stored in a first memory segment. A second 
received image may be temporarily stored in a buffer, for example. The processor stores 
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the second received image in a second memory segment if a condition (selected by the 
user) satisfies a capture state. If not, the second received image may either be discarded 
or overwrite the first received image. The condition may be determined by comparison 
in a pixel differencer, a time-elapse clock, or devices activated by sound (e.g., voice), 
5 motion or light. In the case of the pixel differencer, if the buffer image differs from the 
stored image beyond a particular threshold, the buffer image may be separately stored in 
memory. If the difference does not exceed the threshold, the buffer image may either 
overwrite the previous frame (to update the image) or be discarded. 

An example block diagram of the digital camera 100 for the PDT may be seen in 
□ 10 FIG. 2, wherein an image 102, such as from a viewgraph presentation, is rendered as a 

■ 0 video receiver 104. The video receiver 104 may include a lens, CCD and ADC. The 

o 

J,z received image may be transferred to a JPEG encoder 106. The encoded image frame 

io 

' i! may be stored in memory 108 at a first memory segment. The video receiver 104 may 
include a memory buffer to temporarily maintain a subsequent image before it is 

15 encoded. An encoded image frame may be forwarded to a JPEG decoder 1 10 to send a 
current decoded frame to an pixel differencer 112, which compares the current decoded 
frame to a subsequent image frame in the video receiver 104, The difference quantity 
from the pixel differencer 1 12 is compared to a pixel threshold value in a comparison 
device 114, The threshold requirement 116 may be selected by the user, or may be set at 

20 a default of ten-percent root-mean-squared (rms) between the current and subsequent 
image frames. 

A record-capturing processor 118 may be imposed for determining whether or not 
the subsequent image frame should be stored in memory 108 at the first segment after 
being encoded in the JPEG encoder 106. The comparison device 114 may yield one of 
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two states, depending on whether the image difference from the pixel differencer 112 
exceeds the threshold or not. If the difference from the comparison device 114 exceeds 
the pixel threshold, the subsequent image may be encoded by the encoder 106 and be 
stored in a second memory segment. The selection of a memory segment within the 
5 memory 108 may be performed by a sequencer 120. If the difference does not exceed 
the pixel threshold, the subsequent image may either be discarded or replace the 
previous encoded frame in the first memory segment. If an encoded image frame 
consumes about 100 kB of memory, a typical memory medium of 10 MB used for a PDT 
may be expected to hold about one-hundred image frames. 
^3 10 Alternatively, the pixel differencer 112 may be replaced by a time-elapse clock 

;;L| mechanism, a voice activator, a motion sensor or a light-sensitive device to establish the 

u 

criterion to be compared in the comparison device 114. A clock mechanism may be used 
'1; to enable storing images at a specified interval or image capture frequency rate. A voice 
activator, motion sensor or photon detector in a light-sensitive device may be used to 

■ u 

: 15 determine whether the ambient conditions have altered sufficiently from the most recent 
frame in memory in order that a subsequent image may be stored. 

The sources for audio and video may be made independent of each other, 
permitting reception from separate locations to be used. Video sources may include a 
camera view, hardcopy diagram, an Internet website and a pre-recorded illustration. This 
20 feature also enables Hve meetings to be broadcast over a network. Audio input may be 
received from multiple sources. Selected audio input or time markers may be inserted 
into memory to identify selected portions for AA^ segments to be extracted and 
forwarded to separate destinations. Such markers may facilitate subsequent review of 
selected events in the recording. 

10 
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An example of the separate audio channel may be illustrated in block diagram of 
FIG. 3 featuring the digital camera 122 having common components to those featured in 
FIG. 2 and repeating the same item numbers. In addition to the encoded image frame 
from JPEG encoder 106, the memory 108 also receives an audio input from a first 
microphone "A" 124, to record the speaker's voice during the presentation. A second 
microphone "B" 126 may be included from a remote site (e.g., on a network). 

The audio inputs from microphones "A" 124 and "B" 126 may be combined in a 
mixer 128 for storing in memory 108. The first microphone "A" 124 may altematively 
be input to a voice activated device 130. Sound transmitted through first microphone 
"A" 124 may satisfy the condition storing an image in memory 108. Also, a person or 
object moving within range of a motion sensor may register as an observable change in 
the recording environment, satisfying the condition to store an image frame. 

Playback During Recording 

The PDT may include playback capabiUty from an auxiliary memory location to 
enable review of prior recorded memory segments during simultaneous AA^ recording. 
Because the image as an encoded frame may be directed to a plurality of memory storage 
locations, a previously stored portion of the recording may be retrieved by a playback 
feature while the remainder of the session continues to be recorded. Rapidly responding 
controls for forward, reverse, play and pause may enable the user to access a separate 
playback memory location while leaving the recording memory location undisturbed. A 
decoded frame may be played back from the decoder 1 10 through a LCD display 132 in 
a typical format such as 4:2:0. The audio playback may be performed via a speaker or a 
remote pair of headphones. 
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As an example of this utility, the meeting record may be replayed for a person 
composing the minutes of the meeting or be downloaded to a PC or sent over the 
Internet or by email, if a birowser or email server is installed. Or a late-comer may review 
selected images. The entire meeting may be made available by email or on a web site or 
5 in a database. The browser may have a RealAudio codec and/or a RealVideo codec, in 
which the AA^ recording may be translated into uncompressed files. RealAudio and 
RealVideo are software for streaming audio and video over die Internet, available from 
RealNetworks of Seattle, Washington. 

The AfV recording may be played back locally on the LCD video display unit and 
'3 10 the speaker (for audio output), or alternatively, through a remote display screen and 
|;2 headphone outlet, both connected to the PDT through the digital camera. The LCD 
! J included in the PDT or a separately connected remote display screen might be larger 
' 0 than the video display typically included in a digital camera. 
L FIG. 4 features a block diagram illustrating separate memory segments for 

j j 15 recording and simultaneous playback in the PDT memory. The first memory location 140 
i ^ shows a record with a series of image frames JPEG-1 as 142a, JPEG-2 as 142b, JPEG-3 as 
^'^ 142c, JPEG-4 as 142d, JPEG-5 as 142e, JPEG-6 as 142f and so forth as the recording 
continues. The first memory location 140 also continuously stores an audio track 144 
and a time marker 146. The second memory location 148 shows the same stored image 
20 frames as the first memory location 140 with frames JPEG-1 as 150a, JPEG-2 as 150b, 
JPEG-3 as 150c and JPEG-4 as 150d along with an audio track 152 and a time marker 
154. The second memory location 148 may be truncated when a playback command is 
issued for viewing the stored image frames on the monitor 156 and/or the voice on 
headphones or speaker 158. 
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The feature controls 160 (such as on a control panel) enable the second memory 
location to retum to a first selected time index 162a (or other indicator) to decode and 
view a playback frame depicted at JPEG-2 as 150a on the time marker 154. The 
playback may continue until a stop is selected at second time index 162b. The playback 
may then skip to a third time index 162c to decode and view another playback frame 
JPEG-3 as 150c until fourth time index 162d to view JPEG-4 as 150d. The audio track 
152 may also be heard between the third and fourth time indices 162c and 162d. Such 
playback commands may be issued across a network through a network signal to review 
the second recording segment to a website on the network. 

Memory Optimization 

The PDT may include a memory optimizer to efficiently conserve memory. The 
optimizer may calculate a maximum value for frame resolution, capture frequency, or 
record duration. This calculation may be based on a network data-stream transfer rate 
and the amount of available memory. UtiUzation of memory may be optimized in the 
PDT by selecting a video resolution target and an image capture interval by the user 
control functions. The digital camera processor may calculate the interval between 
captured images during the event being recorded. The processor may calculate the 
available memory subsequent images with a ten-percent rms reserve. 

An example of the memory optimization process in the PDT may be seen in FIG. 5 
featuring a block diagram of the procedure 170. The user may initiate a selection as 172 
of two parameters from three options of target pixel resolution (pixels per frame) as 174, 
the number of image frames as 176 and record duration as 178 (dominated by the 
continuous audio record). The default settings as 180 may provide the remaining third 
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parameter. Supplemental information may also include available memory as 182, 
required memory per frame pixel as 184, and required memory for audio per time period 
as 186. The memory may be described as the audio duration multiplied by the audio 
memory rate plus the number of video frames multiplied by their resolution (pixels per 
5 frame) multiplied by the memory per pixel. 

An algorithm for determining record duration in the first calculator 188 may be 
employed if the target resolution 174 and the number of frames 176 are chosen in the 
user selection 172. The supplemental memory information 182, 184 and 186 may also be 
incorporated to determine the maximum audio duration that may be recorded with the 
S 10 available memory after the video frame requirements are accounted for. Similarly, an 

!;n algorithm to determine the maximum number of image frames in the second calculator 

iJ 

^ 190 niay be used if the user selection 172 includes as parameters the target resolution 
174 and the record duration 178. 

Altematively, an algorithm to determine the maximum frame resolution in the third 
5^ 15 calculator 192 may be used if the user selection 156 includes as parameters the number 
!!" of frames 176 and the record duration 178. The user-selected parameters and the 

calculated and default information may then be used to allocate the memory segments. 
In this manner, die presentation may be recorded with sufficient memory allocated for 
the entire duration and with minimum excess memory. If the images to be captured in 
20 memory are transmitted across a network through a port, the number of image frames 
may be substituted by a capture frequency, since the minimum interval between image 
captures will be based on the data-stream transfer rate. 

On occasion, events may require an alteration from the original preset memory 
allocation. As an example, if more viewgraphs are presented during a meeting than were 
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originally anticipated, the memory may be searched to find a previously stored image 
frame deemed less important in order to be overwritten with a subsequent and more 
important image frame. FIG. 6 presents a block diagram of a memory segment 200 with 
frames JPEG-1 as 202a, JPEG-2 as 202b, JPEG-3 as 202c, JPEG-4 as 202d and so forth, 
an audio track 204 and a time marker 206. The function controls 208 enable the 
memory segment 200 to be reviewed for finding frame JPEG-2 as 202b between indices 
210a and 210b. The image frame stored for JPEG-2 may be overwritten in memory 
device 212 by the subsequent image frame being received through the video input 214. 
Thus, memory may be conserved and an important image may be stored for future use at 
the expense of only an image selected by the user as less important. 

Editor Segregation 

Time-markers may be used to annotate and send segmented portions of the 
recording to designated recipients, directly from the recording. Editing and annotation 
of the recording may be tailored so that specific recipients may have access to only 
those portions selected by the editor. This option may be facilitated through one or 
more user input devices, such as a keyboard, a RCU, control panel, or other cursor- 
pointing device (such as a mouse, trackball, trackpad, or touchscreen), a microphone (for 
voice annotation) and/or a time-mark locator (or other such index identifier to find marks 
placed in memory). Altematively for editing, the AA^ data may be downloaded from the 
PDT to a PC via the exchange of a flashcard. The marking process eliminates the need 
to have multiple persons from separate departments view the entire presentation record 
merely to examine one small portion of interest. Additionally, such record segregation 
enhances security measures to restrict distribution of sensitive information. 
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As an example, in FIG. 7, a presentation record 220 is represented in a block 
diagram featuring a video track 222, an audio track 224 and a time marker 226. The 
video track 222 may be subdivided by image frames JPEG-1 as 228a, JPEG-2 as 228b, 
JPEG-3 as 228c and so forth through JPEG- 16 as 228p. The audio portion may begin 
5 with voice activation events 230, after periods of audio inactivity 232, The time marker 
may be initiated at a relative begin time 0:00 as 234 (such as after voice activation) and 
end at the pre-selected duration of 50:00 (minutes) as 236. 

An editor may decide to create a file 238 that includes JPEG-4 as 228d and JPEG- 
5 as 228e with corresponding audio between time indices 7:57 as 240a and 14:20 as 
^ 3 10 240b. The file 238 may store the time indices as pointers in memory for subsequent 
;;Jj retrieval and review of the frame contents. The editor may alternatively decide to create 

' y an email enclosure 242 for transmission to a selected recipient, with voice annotation 

1.0 

"P from a microphone 244 (added to the audio) or a keyboard 246 for inserting comments 

L of probable interest to the recipient and identifying visual features on the image frames. 

l "^ 15 In this example, the email enclosure 242 captures the recorded period between time 

p indices 29:05 as 248a and 36:42 as 248b. The time-indices are provided for example 
description only, and are not intended to represent any limitation in the claims. 

Image Compression 

20 The video imagery as depicted by a series of multi-pixel frames may constitute the 

largest portion of the memory requirements for an AA^ presentation. In order to reduce 
the memory consumption, the JPEG standard provides a variety of lossy image 
compression methods, such as the widely used discrete cosine transform. Such methods 
convert the pixel attributes into a waveform series, truncating the higher order terms, 
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resulting in reduced memory requirements in exchange for a diminution of detail. Such 
compression may be performed in software or hardware. 

Differences between images may also be used to reduce memory consumption. A 
first image pattern may be stored, followed by either a second image pattern or the 
5 difference between the second and first images. The memory for these may be further 
reduced by performing a transform compression on the first image and the second 
difference. The image difference comparison may examine time-elapse pixel-by-pixel 
changes between the first image to the second iniage. Some image differences may 
represent random noise, but some portions may reflect differences between presentation 
^ 3 10 images or changes otherwise detectable with a motion sensor. The image may be 

^ restored by uncompressing the compressed frame, although the compression technique 

Ij 

J y may cause a minor degradation in fidelity. 

IB 

A representation of this compression technique may be seen in the FIG. 8 block 
p diagram. Image frames may be stored in a memory 250 associated with the PDT. A lossy 
V: 15 image compressor 252 may reduce the quantity of memory 250 needed to store each 
image. A first image frame JPEG-1 as 254 may be compressed by the image compressor 
252 in the PDT resulting in a first compressed frame 256 and stored in memory 250. A 
second image frame JPEG-2 as 258 may also be compressed by the image compressor 
252 resulting in a second compressed frame 260 and stored in memory 250. 
20 The second image frame JPEG-2 as 258 differs from JPEG-1 as 254 in specific 

pixels that may be mapped as a frame difference 262. To exploit this frame difference 
262 for reducing memory consumption, the first image frame JPEG-1 as 254 and the 
second image frame JPEG-2 as 258 may be input to a differencing device 264 to isolate 
and determine the isolated difference 266. This isolated difference 266 may be input to 
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the image compressor 252 as an altemative to the second frame JPEG-2 as 258 to 
produce a compressed difference 268, which may then be stored in memory 250. 

Hardware and Software 
5 In order for the digital camera chip within the PDT to provide much of the above- 

described functionaUty, specific application executable programs should be included as 
software, in cooperation with the operating system (OS) for the RISC processor. The 
PDT software structure shown in FIG. 9 provides an indication of the capability of the 
invention. The software structure may be operated by a RISC chip 270 on which may 
^3 10 run the pSOS as 272. The pSOS 272 in tum executes the digital camera OS as 274, a 
j:0 photograph processing program 276 such as Adobe Photo Delux from Adobe Systems 
[y Inc. of San Jose, California, and an internet protocol (IP) stack 278 providing software 
^'0 for external communication such as transmission control protocol/intemet protocol 

(TCP/IP), hypertext transfer protocol (HTTP), user datagram protocol (UDP), point of 
: J 15 presence (POP), simple mail transfer protocol (SMTP), and file transfer protocol (FTP), 
p The image processing program 276 may include an image compression method as 

^'^ illustrated in FIG. 8 for reducing the memory consumption of stored image frames. The 
IP stack 278 may be connected to a network browser 280, on which an add-on device 
driver 282 such RealAudio and RealVideo may be included. An optional modem code 
20 284 and/or a network connect driver 286 may be included to receive input from a PC 
card 288 among a variety of Internet connection selections. 

The optics for received video input may be placed on a tether to capture images 
from a digital camera positioned a finite distance from and transmitting via the tether to 
the PDT. Multiple tether optics may be connected to the PDT so as to enable 360° (or 
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2n) simultaneous panoramic views for viewer panning or selective view capture or 
panoramic 360° capture. 

The PDT may include a controls feature panel or a remote control unit (RMU) 
along with an optional keyboard. In order to increase flexibility for the user, the 
keyboard may be remapped or have macros built from select keys to reduce keystrokes 
for repeated command sequences. Furthermore, in the event that a flashcard is not 
available, the RCU may be used to download the AA^ data to a remote recorder or to a 
web site having access to a memory medium. 

The PDT may be a standalone device intended for placement on a table or other 
stationary platform for the duration of the event to be recorded, such as a meeting. The 
housing or case for the PDT may be received on a pedestal or other stand for 
maintaining an upright position. A smaller design for the PDT may be connected to a 
wristband with incorporation of a clock to produce a multi-mode wrist-watch that may 
provide time, date, alarm, timer, chronograph, in addition to AA^ recording and playback. 
Alternatively, a smaller PDT design may be insertable in a pocket. 

A block diagram is depicted in FIG, 10 summarizing the components of the 
present PDT invention. An image may be received through a lens 290 and sent to a 
CCD 292, digitally converted in an A/D converter 294 before being received by a digital 
camera chip 296 having software capabilities as described in FIG. 9. A microphone 298 
may receive audio signals to be received by the digital camera chip 296. Associated 
with the digital camera chip 296 are a memory device 300 for recording images and 
audio, along with ROM 302a and DRAM 302b for processing. Optionally, the digital 
camera chip 296 may also be associated with a LCD video display 304, an audio output 
port 306 such as a headphone jack or a speaker, a user-function input device 308 such 
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as a RCU or a keyboard or a control panel, and an Internet connection. An image 
difference comparer 310 may also be included, either by a hardware component or 
within software to perform this function. The user-function input device 308 and the 
Internet connection 312 may be used to provide instructions to the digital camera chip 
5 296. The image difference comparer 308, as described in HG. 2, may compare the 
difference of one image to another image against a threshold input 314, which may be 
supplied by the user-function input device 308 or across an Internet connection 312. 
Images in memory may be stored in memory by the digital camera chip 296 as described 
in FIG. 2, based on the comparison of the image difference to the threshold. 
10 The LCD display may be augmented to include unobtrusive messages for system 

;;L: wamings or for incorporation of instructions or annotation from an optional keyboard or 

m 

RCU. The unobtrusive nature of the messages may enable the video images to be 

in 

' p viewed fully or partially while providing valuable information to the viewer. For 

r-j example, alarm or diagnostic signals may be provided to indicate the viewer or user one 

rU 

i T 15 or more of many possible conditions, such as limits on available memory for image 
capture, error status (e.g., codec failure to compress an image), timeouts such as for 
replacing flashcards, and connection wamings. The LCD display may also have a pan- 
and-scan option with up to 12-size font, so that text on a whiteboard may be read and 
interpreted as text, thereby reducing memory requirements and facilitating alpha-numeric 
20 searches. 

Low-Cost Embodiment 

A lower cost version of the wrist portable PDT might not include a browser or 
Internet connection, thus requiring less DRAM and eliminating the need for a second PC 
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card slot. The tethered optics may also sacrifice quality to reduce cost, such as a PC 
desktop camera eye with video graphics array (VGA) resolution or a pen camera with 
less than VGA resolution. As with the standalone PDT, the wrist portable PDT has a 
number of I/O ports to receive or transfer data. 

One embodiment of the PDT can be seen in FIG. 1 1 for the platform model. The 
platform model 320 may comprise a digital camera 322 in a case 324, a LCD display 326 
for video display, a speaker 328 for audio broadcast, one or two PC cards 330 with 
appropriate insert slots, digital camera optics 332 on a digital bus tether 334, an optional 
mini-keyboard 336 connected by a tether 338, an optional pair of headphones 340 for 
audio output, and an optional stand 342 for removably positioning the model 320. The 
stand 342 may have flat base and quadrilateral front view. The digital camera 322 may 
feature a power on/off switch 344, a function select button 346, a digital camera 
function command panel 348, arrow keys 350 for cursor control, a headphone jack 352 
for the optional headphones 340, a microphone 354, a miniature trackball (or mouse- 
ball) 356 and an enter key 358. 

The function select button 346 may enable keyboard attachment, an RCU, PC 
synchronization (for data transmission), or an electronic-book page-tumer. The display 
326 may be 7.5 inches diagonal (rather than 2 inches diagonal in a typical digital 
camera) with an image arrangement of 640x480 pixels. The PC cards 330 may be used 
for transmission to flash memory or receipt of an Intemet connection. 

Another embodiment of the PDT can be seen in FIG. 12 for the web-capable wrist 
mobile model. The wrist mobile Mtg Mate 360 includes a LCD display 362 (suggesting 
a resemblance to a "Dick Tracy" wristwatch) and an output port 364 to support a larger 
display unit 366. The digital camera function control panel 368 provides access to 
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interface commands to the digital camera, and includes the same or similar features as 
depicted in the FIG. 10 panel 348. Also included may be digital camera input for optics 
370, a headphone jack 372 to support a pair of headphones 374 with an optional 
microphone 376, a microphone 378, a speaker 380, and a pair of PC cards 382 and 384 
in their respective card slots shown in overlapped fashion. Physically attached to the 
Mtg Mate 360 is a housing 386 that may be integrated to a flexible wrist strap 388, 
which can then be removably wrapped around an arm for wrist portability. 

Yet another embodiment of the PDT can be seen in FIG. 13 for die low-cost wrist 
mobile model. The low-cost wrist mobile Mtg Mate 390 includes a LCD display 392. 
The PDT functions are accessed on the panel 394 shown below the display 392. Within 
the vicinity of the panel 394 may be located a speaker 396, a jack for headphones 398, a 
microphone 400, and an input optics port 402 for receiving remote tethered optics, such 
as a webcam 404 connected via a universal serial bus (USB) 406, a pen camera 408, a 
camera eye 410 or digital camera optics 412. A single compact flash card 414 is inserted 
in a port, with dashed lines indicating the interior PDT region occupied by the card. The 
display 392 and panel 394 may be contained within a housing 416 and connected to a 
wrist strap 418 by means of a flexible hinge on either side of the housing 416. 

While embodiments and appUcations of the invention have been shown and 
described, it would be apparent to those of ordinary skill in the art, after a perusal of the 
within disclosure, that many more modifications than mentioned above are possible 
without departing from the inventive concepts herein. The invention, therefore, is not to 
be restricted except in the spirit of the appended claims. 
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